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IMAGE PICKUP APPARATUS 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image pickup 
apparatus capable of picking up a dynamic image or a 
still image such as a video camera. 
Related Background Art 

In a digital color camera, in response to pressing 
down of a RELEASE button, an image in a field is 
exposed to a solid-state image pickup element such as a 
CCD or a CMOS sensor for a desired time period. An 
image signal thus obtained and representing a still 
image of a picture is converted into a digital signal 
and is subject to predetermined processing such as the 
YC processing, and the image signal of a predetermined 
format is obtained. Digital image signal representing 
the picked-up image is recorded in a semiconductor 
memory on a one picture basis. The recorded image 
signal is read according to the need, to be reproduced 
as signal capable of being displayed or printed, and 
are outputted to a monitor or the like to be displayed. 

One example of a technology for thinning a digital 
color camera is disclosed in Japanese Patent 
Application Laid-open No. 10-145802. In Japanese 
Patent Application Laid-open No. 10-145802, an image 
pickup screen is divided into a plurality of regions, 



and an imaging optical system is provided for each of 
the regions to form a partial image of an object. In 
this case, one object image is formed by one imaging 
optical system, and object images the number of which 
corresponds to the number of the divisions of the image 
pickup screen are projected onto a single image pickup 
element. In addition, object image separating walls 
referred to as visual field limit baffles are provided. 
The visual field limit baffles are disposed between the 
imaging optical systems and the image pickup element, 
and function as walls for preventing light from 
adjacent imaging optical systems from leaking in. 

Since the visual field limit baffles are 
partitions in image pickup regions, the more image 
pickup regions are segmentized, the more area is 
necessary for the visual field limit baffles. This is 
an obstacle to miniaturization of the image pickup 
element. It lowers the production yield to make larger 
the whole area of the image pickup element extremely, 
and, due to limitation on the cost, an upper limit is 
practically placed on the size of the image pickup 
element . 

SUMMARY OF THE INVENTION 

According to one aspect of the present invention, 
there is provided an image pickup apparatus comprising 
first and second image pickup portions for receiving at 
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least a first: wavelength component of an object light 
and a second wavelength component of the object light 
different from the first wavelength component, 
respectively, a first optical system for projecting the 
5 object light onto the first image pickup portion, a 

second optical system for projecting the object light 
onto the first and second image pickup portions via an 
optical path different from that of the first optical 
system, and a guide path forming portion for forming a 

10 guide path which receives the object light projected by 
the first optical system and guides the received object 
light to the first image pickup portion and for 
receiving the object light projected by the second 
optical system onto the first image pickup portion and 

15 not guiding the received object light to the first 

image pickup portion. The image pickup apparatus of 
the present invention does not require an object image 
separating wall, and can attain small-sized apparatus. 

Other aspects of the present invention will become 

20 apparent from the following specific preferred 
embodiments . 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a sectional view of an image pickup 
25 system of a digital color camera according to an 
embodiment of the present invention; 

Fig. 2 is a front view of a solid-state image 
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pickup element of the image pickup system shown in Fig. 
1; 

Fig. 3 is a plan view of a diaphragm of the image 
pickup system shown in Fig. 1; 
5 Fig. 4 illustrates the ranges where optical 

filters of the image pickup system shown in Fig. 1 are 
formed; 

Fig. 5 illustrates an objective lens of the image 
pickup system shown in Fig. 1 which is viewed from the 
10 side where light is projected; 

Fig. 6 is a graph showing the spectral 
transmission factor characteristics of the optical 
filters of the image pickup system shown in Fig. 1; 

Fig. 7 is a graph showing the spectral 
15 transmission factor characteristics of a color purity 
correction filter of the image pickup system shown in 
Fig. 1; 

Fig. 8 is a graph showing the spectral 
transmission factor characteristics of a photochromic 
20 glass of the image pickup system shown in Fig. 1; 

Fig. 9 is a graph showing the transmission factor 
distribution of a transmission factor distribution type 
filter of the image pickup system shown in Fig. 1; 

Fig. 10 is a graph showing the OTF characteristics 
25 of the objective lens of the image pickup system shown 
in Fig. 1; 

Fig. 11 is a graph showing the intensity 
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distribution in an image by the image pickup system 
shown in Fig. 1; 

Fig. 12 is an explanatory view for explaining the 
setting of the intervals between lens portions of the 
5 image pickup system shown in Fig. 1; 

Fig. 13 is an explanatory view for explaining the 
positions of images of an object at infinity of the 
image pickup system shown in Fig. 1; 

Fig. 14 is a block diagram of a signal processing 
10 system of the digital color camera shown in Fig. 1; 

Fig. 15 illustrates the positional relationship of 
the image pickup region for R and B pixels with respect 
to the image pickup region for a G pixel of the image 
pickup system shown in Fig. 1; 
15 Fig. 16 is an explanatory view of interpolation 

processing of the digital color camera shown in Fig. 1; 

Figs. 17A, 17B, and 17C illustrate the overall 
structure of the digital color camera shown in Fig. 1; 

Fig. 18 is a sectional view of an image pickup 
20 system of a digital color camera according to a second 
embodiment of the present invention; 

Fig. 19 is a sectional view of another image 
pickup system of a digital color camera according to 
the second embodiment of the present invention; 
25 Fig. 20 is a front view of a solid-state image 

pickup element according to the second embodiment of 
the present invention ; 
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Fig, 21 is a sectional view of an image pickup 
system of a digital color camera according to a third 
embodiment of the present invention; 

Fig* 22 is a front view of a solid-state image 
5 pickup element of the image pickup system shown in Fig. 
21; and 

Fig. 23 is an explanatory view of the action of a 
microlens of the image pickup system shown in Fig. 21. 



10 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Preferred embodiments of the present invention are 
now described in detail with reference to the drawings. 

Figs. 17A, 17B, and 17C illustrate the overall 
structure of a digital color camera according to a 
15 first embodiment of the present invention. Figs. 17A, 
17C, and 17B are a front view, a rear view, and a 
sectional view taken along the line 17B-17B in the rear 
view of Fig. 17C, respectively. 

In Figs. 17A, 17B, and 17C, reference numeral 1 
20 denotes a camera body. An illuminating light intake 
window 2 formed of a white diffusing plate is 
positioned at the back of a color liquid crystal 
monitor 4. Reference numerals 5 and 6 denote a main 
switch and a RELEASE button, respectively. Reference 
25 numerals 7, 8, and 9 are switches for a user to set the 
state of the camera. In particular, the reference 
numeral 9 denotes a PLAY button. A reference numeral 



13 denotes a display of the remaining number of 
recordable pictures. Object light which is incident 
into a prism 12 from a viewfinder front frame 3 is 
projected from a viewfinder eyepiece window 11. 
Reference numerals 10 and 14 denote an image pickup 
system and a connection terminal for connecting to an 
external computer or the like to transmit and receive 
data, respectively. 

The schematic structure of a signal processing 
system is now described. Fig. 14 is a block diagram of 
the signal processing system. This camera is a single 
plate type digital color camera using a solid-state 
image pickup element 120 such as a CCD or a CMOS 
sensor. Image signals representing a dynamic image or 
a still image are obtained by driving the solid-state 
image pickup element 120 continuously or only once. 
Here, the solid-state image pickup element 120 is an 
image pickup device of the type which converts exposed 
light into electric signals with regard to the 
respective pixels, stores respective charges according 
to the light amount, and reads the respective charges. 

It is to be noted that Fig. 14 only shows portions 
which are directly relevant to the present invention, 
and illustration and description of portions which are 
not directly relevant to the present invention are 
omitted. 

As shown in Fig. 14, the image pickup apparatus 
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has the image pickup system 10, an image processing 
system 20 as an image processing means, a recording and 
reproduction system 30, and a control system 40. 
Further, the image pickup system 10 includes therein an 
5 objective lens 100, a diaphragm 110, and the solid- 
state image pickup element 120, the image processing 
system 20 includes therein an A/D converter 500, an RGB 
image processing circuit 210, and a YC processing 
circuit 230, the recording and reproduction system 30 

10 includes therein a recording processing circuit 300 and 
a reproduction processing circuit 310, and the control 
system 40 includes therein a system control unit 400, 
an operation detection circuit 410, and a drive circuit 
420 of the solid-state image pickup element. 

15 The image pickup system 10 is an optical 

processing system for imaging light incident from an 
object through the diaphragm 110 and the objective lens 
100, on an image pickup plane of the solid-state image 
pickup element. The light transmission factor of the 

20 objective lens 100 is adjusted to expose a subject 

image of an appropriate light amount to the solid-state 
image pickup element 120. As described in the above, 
as the solid-state image pickup element 120, an image 
pickup device such as a CCD and a CMOS sensor is 

25 applied. By controlling the exposure time and the 
exposure intervals of the solid-state image pickup 
element 120, image signals representing continuous 



- 9 - 



dynamic images or image signals representing a still 
image by one exposure can be obtained . 

Fig* 1 is a detailed view of the image pickup 
system 10. First, the diaphragm 110 has three circular 
5 openings 110a r 110b, and 110c as shown in Fig. 3. 

Object light which enters a light incidence plane lOOe 
of the objective lens 100 from the openings are 
projected from three lens portions 100a, 100b, and 100c 
of the objective lens 100 to form three object images 

10 on the image pickup plane of the solid-state image 
pickup element 120. The diaphragm 110, the light 
incidence plane lOOe, and the image pickup plane of the 
solid-state image pickup element 120 are in parallel 
with one another. In this way, by making weak the 

15 power on the incidence side, making strong the power on 
the projection side, and providing a diaphragm on the 
incidence side, the curvature of the image plane can be 
made less. It is to be noted that, though the light 
incidence plane lOOe of the objective lens 100 is a 

20 plane here, the light incidence plane lOOe may be 

formed of three spherical surfaces or three rotation- 
symmetry nonspherical surfaces. 

The three lens portions 100a, 100b, and 100c have 
circular spherical surface portions as shown in Fig. 5 

25 showing the objective lens 100 viewed from the side 
where light is projected. An infrared radiation 
cutting filter having a low transmission factor with 
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regard to the wavelength range of 670 nm and more is 
formed on the spherical surface portions while a light- 
shielding film is formed on a plane portion lOOd shown 
with hatching. More specifically, the objective 
optical system is formed with the objective lens 100 
and the diaphragm 110, while the three lens portions 
100a, 100b, and 100c are the imaging system. 

The manufacturing is easy with using glass molding 
in case the objective lens 100 is made of glass and 
with using injection molding in case the objective lens 
100 is made of resin. 

Fig. 2 is a front view of the solid-state image 
pickup element 120. The solid-state image pickup 
element 120 is provided with three image pickup regions 
120a, 120b, and 120c corresponding to the formed three 
object images. Each of the image pickup regions 120a, 
12b, and 120c are sized to be 2.24 mm x 1.68 mm with 
the arrangement of 800 x 600 pixels having the vertical 
and horizontal pitch of 2.8 pm. The size of the whole 
image pickup regions is 2.24 mm x 5.04 mm. The 
diagonal size of each of the image pickup regions is 
2.80 mm. In the figure, image circles 51a, 51b, and 
51c within which an object image is formed are 
circular, the sizes of which circles are determined by 
the size of the openings of the diaphragm and the 
spherical surface portions on the projection side of 
the objective lens 100. The image circles 51a and 51b 
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overlap each other and the image circles 51b and 51c 
overlap each other. 

In Fig. 1, hatched portions 52a, 52b, and 52c 
sandwiched between the diaphragm 110 and the objective 
5 lens 100 are optical filters formed on the light 

incidence plane lOOe of the objective lens 100. As 
shown in Fig. 4 showing the objective lens 100 viewed 
from the light incidence side, the optical filters 52a, 
52b, and 52c are formed in regions which completely 
10 include the diaphragm openings 110a, 110b, and 110c, 
respectively . 

The optical filter 52a has spectral transmission 
factor characteristics shown as G in Fig. 6 which 
mainly transmit green, the optical filter 52b has 
15 spectral transmission factor characteristics shown as R 
which mainly transmit red, and the optical filter 52c 
has spectral transmission factor characteristics shown 
as B which mainly transmit blue, and thus, these are 
primary color filters. As the product with the 
20 characteristics of the infrared radiation cutting 
filter formed on the lens portions 100a, 100b, and 
100c, the object images formed in the image circles 
51a, 51b, and 51c are of green light component, red 
light component, and blue light component, 
25 respectively. 

On the other hand, optical filters 53a, 53b, and 
53c are formed on the three image pickup regions 120a, 
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120b, and 120c, respectively, of the solid-state image 
pickup element 120. Their spectral transmission factor 
characteristics are equivalent to the ones shown in 
Fig. 6. More specifically, the image pickup regions 
120a, 120b, and 120c are sensitive to green light ( G ) , 
red light (R), and blue light (B), respectively. 

Since the spectral distributions of the received 
light of the respective image pickup regions are given 
as the product of the spectral transmission factors of 
the pupils and the spectral transmission factors of the 
image pickup regions, respectively, the combination of 
the pupil and the image pickup region is selected 
according to the wavelength range. More specifically, 
object light which goes through the diaphragm opening 
110a is mainly photoelectrically converted in the image 
pickup region 120a, object light which goes through the 
diaphragm opening 110b is mainly photoelectrically 
converted in the image pickup region 120b, and object 
light which goes through the diaphragm opening 110c is 
mainly photoelectrically converted in the image pickup 
region 120c. In other words, the image pickup regions 
120a, 120b, and 120c output a G image, an R image, and 
a B image, respectively. In this way, by using 
multiple optical filters for the purpose of color 
separation on the pupils of the image pickup optical 
system and on the image pickup element, the color 
purity can be enhanced. This is because, by using the 



- 13 - 



same kind of optical filters twice, the buildup of the 
transmission factor characteristics becomes steeper and 
the red color (R) and the blue color (B) do not overlap 
each other. It is to be noted that the transmission 
factors of the optical filters 52a, 52b, and 52c or of 
the optical filters 53a, 53b, and 53c are preferably 
set so as to provide appropriate signal levels in the 
respective image pickup regions in the same 
accumulation time . 

In the image processing system 20, a color image 
is formed based on the selective photoelectric 
conversion output obtained from the plurality of images 
by the plurality of image pickup regions of the solid- 
state image pickup element 120, respectively. Here, 
since the peak wavelength of the spectral luminous 
efficiency is 555 nm, the signal processing is carried 
out using a G image signal including this wavelength, 
as the reference image signal . 

When the pixel pitch of the solid-state image 
pickup element is fixed, compared with a system adopted 
generally by a digital color camera in which an RGB 
color filter is formed on the solid-state image pickup 
element with, for example, 2x2 pixel block basis to 
provide wavelength selectability to each pixel, and 
thus, an object image is separated into RGB images, the 
size of the object image is 1//3 times, and thus, the 
focal length of the objective lens is about 1//3 times, 
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which is quite advantageous in thinning the camera. 

It is to be noted that, with regard to the 
spectral transmission factor characteristics of the 
optical filters 52a, 52b, and 52c and of the optical 
5 filters 53a, 53b, and 53c, as shown in Fig. 6, R and G 
overlap each other and G and B overlap each other, 
though R and B are almost separated from each other. 

Therefore, even when the image circle 51b of the 
red light overlaps the image pickup region 120c for 

10 photoelectrically converting the blue light, and 

conversely, even when the image circle 51c of the blue 
light overlaps the image pickup region 120b for 
photoelectrically converting the red light, these 
images do not become the output of the image pickup 

15 regions. However, at the portion where the image 

circle 51b of the red light overlaps the image pickup 
region 120a for photoelectrically converting the green 
light and at the portion where the image circle 51a of 
the green light overlaps the image pickup region 120b 

20 for photoelectrically converting the red light, a small 
amount of an image of a different wavelength which 
should be blocked is superimposed. More specifically, 
since the selectivity of the object image is given by 
the product of the spectral transmission factor 

25 characteristics of the optical filter 52a and the 

spectral transmission factor characteristics of the 
optical filter 53b, and by the product of the spectral 



transmission factor characteristics of the optical 
filter 52b and the spectral transmission factor 
characteristics of the optical filter 53a, the cross 
talk of the R image signal and the G image signal does 
not become zero although it is small. 

Therefore, the objective lens 100 is further 
provided with characteristics to lower the transmission 
factor of the wavelength range of the portion where R 
and G overlap each other. This can be carried out by- 
using optical filtering technology implemented by a 
color purity correction filter. 

The color purity correction filter is an optical 
filter formed of a base material made of a transparent 
synthetic resin or glass having a predetermined amount 
of rare-earth metal ions contained therein. 

As the rare-earth metal ions, one or more selected 
among neodymium ions, praseodymium ions, erbium ions, 
holmium ions are used. However, it is preferable that 
at least neodymium ions are used as indispensable ions. 
It is to be noted that trivalence ions are generally 
used as these ions. The content of the metal ions is 
selected in a range of normally 0.01 to 40 mass parts, 
preferably 0.04 to 30 mass parts relative to 100 mass 
parts of the base material of the objective lens 100. 

As shown in Fig. 7, the color purity correction 
filter has characteristics to selectively absorb light 
in a predetermined wavelength range between the peak 



wavelengths of the color components of R, G, and B to 
decrease the amount of transmission thereof. This 
action almost eliminates cross talk due to the overlap 
of the image circle 51b of the red light and the image 
pickup region 120a for photoelectrically converting the 
green light and the overlap of the image circle 51a of 
the green light and the image pickup region 120b for 
photoelectrically converting the red light. 

Further, the objective lens 100 is also provided 
with photochromic characteristics which is a phenomenon 
to be darkened by light and to be reversibly 
achromatized when the irradiation of light is stopped. 
This is for, since the accumulation time control range 
of the solid-state image pickup element 120 is limited, 
suppressing the amount of light reaching the solid- 
state image pickup element when the field is extremely 
bright, thereby enlarging the recordable intensity 
range . 

As the photochromic glass, for example, 
photochromic glass of phosphate glass made by Chance- 
Pilkington which has been put to practical use for 
spectacles (Product name: Reactolite Rapide) may be 
used . 

Fig. 8 is a graph showing the spectral 
transmission factor characteristics of a photochromic 
glass used as the objective lens 100. In Fig. 8, a 
solid line shows the characteristics after exposure to 
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sunlight for 20 minutes while a broken line shows the 
characteristics with no exposure to sunlight. When the 
camera is carried about with the user outdoors under a 
blue sky or the like, light beams which enter the 
objective lens 100 from the diaphragm 110 makes the 
objective lens 100 itself darkened to suppress the 
amount of light entering the solid-state image pickup 
element 120 to be about 1/2. As a result, the 
accumulation time can be made twice as long, which 
raises the control limitation on the high intensity 
side. 

The screen size of each of the image pickup 
regions 120a, 120b, and 120c is 2.24 mm x 1.68 mm as 
described in the above, since the pixel pitch is 2.8 pm 
and the number of the pixels are 800 x 600. The 
diagonal screen size of each of the image pickup 
regions is 2.80 mm. Generally, when the image pickup 
angle 0 of a small-sized camera is about 70° in the 
diagonal direction, the camera is most convenient. 
When the image pickup angle is 70°, the focal length is 
2.0 mm in this case, since it is determined by the 
diagonal size of the screen. 

When a person or the like is the subject of 
recording, considering that a person is about 170 cm 
tall and one person to three people are often recorded 
at a time, a virtual distance D to the subject [m] can 
be defined as in the following equation (1) as a 
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function of the image pickup angle 6[°]: 

D = 1.4 / tan (0/2) ... (1) 

Substituting 70° for 9 of equation (1), D = 2.0 m 
is obtained. Here, if the image pickup system 10 is 
5 formed so as to focus on the subject best when the 

distance to the subject is 2 m, the letting out of the 
lens from the point at infinity is 0.002 mm. Taking 
into consideration the allowable circle of confusion to 
be described later, there causes practically no problem 

10 even if the image pickup system is a fixed focus image 
pickup optical system without a mechanism for letting 
the lens out. 

A focal length f of a planoconvex lens put in the 
air can be represented as follows: 

15 f = {1 / (1-n)} r ... (2) 

wherein n is the index of refraction and r is the 
radius of the spherical surface. Therefore, if the 
index of refraction n of the objective lens 100 is 1.5, 
for example, r for obtaining the focal length of 2.0 mm 

20 is 1.0 mm. 

It is convenient to make equal the sizes of the 
red, green, and blue object images, since there is no 
need to make correction of the image magnification, and 
thus, the processing time is not elongated. Therefore, 

25 the lens portions 100a, 100b, and 100c are optimized 

for the peak wavelengths of 530 run , 620 nm, and 450 nm 
of the lights which go through the RGB optical filters, 
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respectively to make equal the magnifications of the 
respective images. This can be paraxially materialized 
by making equal the distance from the positions of the 
principal points of the respective lens portions to the 
solid-state image pickup element. 

In case of glass with the index of refraction of 
the d line (587.6 nm) n d = 1.5 and the Abbe number v d = 
60, the indexes of refraction at the wavelengths of 530 
nm, 620 nm, and 450 nm are about 1.503, 1.499, and 
1.509, respectively. If all the radii r of the 
spherical surfaces of the lens portions 100a, 100b, and 
100c equal -1.0 mm, the focal lengths at the respective 
wavelengths are, by the equation (2), as follows: 

the lens portion 100a having the representative 
wavelength of 530 nm : 1.988 mm, 

the lens portion 100b having the representative 
wavelength of 620 nm : 2.004 mm, and 

the lens portion 100c having the representative 
wavelength of 450 nm : 1.965 mm. 

Suppose from the pixel pitch that the allowable 
circle of confusion is 3.0 pm and further suppose that 
the f -number of the objective lens is F5.6, the depth 
of focus represented as the product of the two is 16.8 
pm. It can be seen that the difference 0.039 mm 
between the focal length in case of 620 nm and the 
focal length in case of 450 nm already exceeds this. 
More specifically, though the paraxial image 
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magnif ications are the same, depending on -the color of 
the subject, the subject may be out of focus. Since 
the spectral transmission factor of an object normally 
ranges over a wide wavelength range, it is quite rare 
5 that a sharp image in focus can be obtained. 

Accordingly, the radii r of the spherical surfaces 
of the lens portions 100a, 100b, and 100c are optimized 
with regard to the respective representative 
wavelengths. More specifically, here, no achromatism 
10 for removing the chromatic aberration over the whole 
visible region is not carried out and designs for the 
wavelengths are applied to the respective lenses. 
First, the equation (2) is transformed to obtain the 
following equation ( 3 ) : 
15 r = (1-n) f ... (3) 

Inserting f = 2.0 and inserting in sequence n = 
1.503, n = 1.499, and n = 1.509 in the equation (3), 
the following respective radii are calculated: 

the lens portion 100a having the representative 
20 wavelength of 530 nm : r = -1.006 mm, 

the lens portion 100b having the representative 
wavelength of 620 nm : r = -0.998 mm, and 

the lens portion 100c having the representative 
wavelength of 450 nm : r = -1.018 mm. 
25 in order to make well-balanced the difference in 

the image magnifications at a high position of an 
image, the heights of the vertices of the lens portions 



100a, 100b, and 100c are slightly adjusted, and then, 
both the sharpness and the image magnification are 
ideal. Further, non-spherical surfaces are used for 
the respective lens portions to satisfactorily correct 
the curvature of the image plane. With regard to the 
distortion of the image, it can be corrected in the 
signal processing to be carried out later. 

In this way, when reference G image signals by the 
green object light including the wavelength of 555 nm 
which has the highest luminosity factor and image 
signals by the red and blue object lights, 
respectively, are obtained, and different focal lengths 
are set with regard to one wavelength and a 
substantially equal focal length is set with regard to 
the representative wavelengths in the respective 
spectral distribution in the imaging system, then by 
compositing these image signals, a color image with 
satisfactory correction of the chromatic aberration can 
be obtained. Since each of the imaging systems is 
formed of one lens, there can be also attained 
technological advantage of thinning the imaging system. 
Further, though achromatism normally requires a 
combination of two lenses having different dispersions, 
the achromatism is carried out here by only one lens, 
and thus, there can be also attained technological 
advantage of lowering the cost. 

The objective lens 100 is required to have high 
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contrast: image dissection up to the spatial frequency 
range as high as the pixel pitch. The image pickup 
system 10 takes in three object images with regard to 
the three wavelength ranges, and thus, compared with an 
image pickup system provided with a mosaic optical 
filter such as of the Baiyer arrangement having the 
same number of pixels, as described in the above, the 
focal length is about 1//3 times to attain the same 
image pickup angle. Therefore, it is necessary to 
materialize high contrast image dissection of higher 
spatial frequency component. The optimization with 
regard to the respective wavelengths of the lens 
portions described in the above is a technology for 
suppressing the chromatic aberration for the purpose of 
materializing this . 

Generally, there are two methods of improving the 
aberration characteristics of an image pickup optical 
system to make spurious resolution less liable to 
occur, thereby alleviating problems: one is to increase 
the degree of freedom in designing by, for example, 
increasing the number of lenses forming the system, by 
making the lenses nonspherical , using anomalous 
dispersion glass, or by complexly using diffraction 
optical elements; and the other is to make narrower the 
imaging light beam. 

The former method, that is, increase of the degree 
of freedom in designing is, though the focal length is 
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1//3 times, toward complexity of the structure of the 
objective optical system, which goes against thinning 
of the image pickup apparatus, and thus, is 
inappropriate. On the other hand, the latter method, 
that is, use of a narrower light beam conforms to a 
thin image pickup apparatus. 

When an imaging light beam is made narrower, as 
shown by a solid line b in Fig. 10, the response 
function referred to as OTF presents gradual monotone 
decrease in the low frequency component, and after 
that, becomes slightly negative, and then, becomes 
slightly positive. On the other hand, in case a broad 
light beam without narrowing is used, as shown by a 
broken line a in Fig. 10, the response function 
presents steep decrease in the low frequency component, 
and after that, becomes temporarily negative, and then, 
becomes positive again. 

The state where the OTF is negative indicates 
occurrence of spurious resolution. This corresponds to 
an actual state where reversal of negative/positive 
occurs, that is, a portion which should be white is 
black while a portion which should be black is white. 
It makes it clear that a natural image can be obtained 
by making narrower the imaging light beam. 

However, when the imaging light beam is extremely 
narrowed, the contrast in a high frequency range is 
decreased due to diffraction of light. In this state, 
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an image is formed of a bright spot at the center and 
diffraction stripes surrounding the bright spot. These 
are caused by, as known well, relative increase in the 
intensity of the diffraction stripes due to peripheral 
5 waves generated on the periphery of the opening of the 
diaphragm. 

The diffraction stripes can be decreased by adding 
to the objective lens a filter which is transparent at 
the center and becomes darker toward the periphery. 

10 This method is referred to as apodization, which is 
described in detail on pages 172 to 174 of "Kogaku 
Gijutsu Handbook Zohoban (Handbook of Optical 
Technology, Enlarged Edition)" (1975, Asakura Shoten). 
Fig. 9 is a graph showing the transmission factor 

15 distribution of transmission factor distribution type 
filters provided on the light incidence plane lOOe of 
the objective lens 100 so as to face the diaphragm 
openings 110a, 110b, and 110c. The transmission factor 
distribution type filters are denoted as 54a, 54b, and 

20 54c in Fig. 1. The positions where the transmission 

factor is the highest correspond to the centers of the 
diaphragm openings 110a, 110b, and 110c while the 
positions where the transmission factor is zero 
correspond to the periphery of the openings 110a, 110b, 

25 and 110c, respectively, of the diaphragm. In other 

words, the transmission factor is distributed so as to 
be the highest at the centers of the diaphragm openings 
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and so as to monotonically decrease toward the 
periphery. 

Such a transmission factor distribution type 
filter is formed by forming a thin film of Inconel, 
5 Chromel , chromium or the like by vapor deposition or 

sputtering on the light incidence side of the objective 
lens 100. The characteristics shown in Fig. 9 can be 
obtained by making the thin film the thinnest at the 
center and the thickest on the periphery. It is to be 

10 noted that, in forming such a thin film, the position 

of a mask used in the vapor deposition or sputtering is 
continuously controlled . 

Though the transmission factor distribution type 
filters 54a, 54b, and 54c are formed on the objective 

15 lens here, the structure may be that they are formed on 
a glass plate and are arranged on the light incidence 
side or the light projection side of the objective lens 
100. 

Fig. 11 is a graph showing the intensity 
20 distribution in an image. In the figure, a broken line 
a shows a case where the transmission factor is 
constant over the whole diaphragm opening, while a 
solid line b shows a case where the transmission factor 
is decreased from the center of the diaphragm opening 
25 toward the periphery. Compared with the case of the 
characteristics shown by a, there is no bound on the 
periphery of the image in the characteristics shown by 
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b, which clearly shows that the image formed is 
satisfactory. Here, This ref erects technological 
advantage of decreasing the diffraction stripes by 
decreasing peripheral light beams by means of 
apodization . 

Next, the relationship between the objective lens 
and the image pickup regions is described. Since the 
image pickup system has three lens portions, the 
positions of the three object images relatively change 
according to the distance to the subject. As described 
in the above, each of the image pickup regions is sized 
to be 2.24 mm x 1.68 mm, and the image pickup regions 
are arranged adjacent to each other with their long 
sides being in contact with each other. Therefore, the 
center to center distance of adjoining image pickup 
regions is 1.68 mm. In the YC processing circuit 230 
to be described later, signal processing is carried out 
on the assumption that the center of an object image is 
the center of the image pickup region. When an object 
image with the virtual object distance of 2 m is to be 
formed on the image pickup portion at the same 
intervals as that distance, as shown in Fig. 12, the 
interval between the lens portions 100a and 100b and 
between the lens portions 100b and 100c is set to be 
1.6783 mm. In the figure, arrows 55a, 55b, and 55c 
denote imaging systems having positive power by the 
three lens portions 100a, 100b, and 100c of the 
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objective lens 100, respectively, rectangles 56a, 56b, 
and 56c denote the ranges of the image pickup regions 
120a, 120b, and 120c, respectively, and LI, L2, and L3 
are optical axes of the imaging systems 55a, 55b, and 
55c, respectively. Since the light incidence surface 
of the objective lens 100 is a plane and the lens 
portions 100a, 100b, and 100c to be the light 
projection surface are spherical surfaces, 
perpendiculars from the respective centers of the 
spheres to the light incidence plane lOOe are the 
optical axes. 

Here, as shown in Fig. 13, images of an object at 
infinity are formed at the same intervals as that of 
the lens portions 100a, 100b, and 100c, and thus, the 
interval between the G object image and the R object 
image and the interval between the R object image and 
the B object image are 1.6783 mm, which is a little 
smaller than the center-to-center distance of the image 
pickup regions of 1.68 mm. The difference AY is 0.0017 
mm, i.e., 1.7 jam. With the G object image which has 
the highest luminosity factor being as the reference 
object image, when the B object image moves, the 
difference AY is doubled and is 3.4 pm. Since it is 
often the case that a short-range object such as a 
person is positioned in the middle of a picture to be 
picked up and that a long-range object is positioned on 
the periphery of the picture, and, since the aberration 
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of the objective lens increases on the periphery of the 
picture to lower the quality of an image, it can be 
understood that there is practically no problem if the 
maximum image interval change is smaller than the pixel 
pitch multiplied by two. As described in the above, 
since the pixel pitch P of the solid-state image pickup 
element 120 is 2.8 pm, it follows that AY < 2 x P, and 
thus, the color misalignment in an image at infinity to 
this extent is allowable. 

Further, the interval between the images varies 
also according to temperature change of the image 
pickup system 10. Since the imaging magnification of 
the image pickup system 10 is extremely small, the 
image interval variation AZ can be expressed as the 
difference between the expansion of the objective lens 
and the expansion of the solid-state image pickup 
element in the following equation (4): 

Z = 1.68 x (aL - aS) x AT (4) 

wherein aS is the coefficient of linear expansion of 
the solid-state image pickup element 120, aL is the 
coefficient of linear expansion of the objective lens 
100, and AT is the temperature change. 

Here, when aS = 0.26 x 10" 5 , AT =» 20[°C], and the 
objective lens 100 is formed of low-melting glass and 
aL = 1.2 x 10" 5 , AZ is calculated at 0.00032 [mm]. This 
is the variation in the interval between the G object 
image and the R object image and the variation in the 
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interval between the R object image and the B object 
image . 

When the B object image is regarded as a variation 
with respect to the G object image which is the 
5 reference image signals, since the interval between the 
images is 1.68 x 2, the image interval variation is Az 
x 2 = 0.00063 [mm]. When the temperature range where 
the camera is used is 0 to 40°C, the deviation AT from 
the reference temperature of 20 °C is 20° C. Here, if Az 

10 x 2 is smaller than 1/2 of the pixel pitch, there is 

practically no problem. Generally, the coefficient of 
linear expansion aS of the solid-state image pickup 
element 120 is as small as about 0.26 x 10" 5 , it is 
necessary to select the coefficient of linear expansion 

15 aL of the objective lens 100 so as to satisfy the 
following expression ( 5 ) : 

2 x A x (aL - 0.26 x 10 -5 ) x 20 < 1/2 P ... (5) 
wherein A is either the interval between the G image 
and the R image or the interval between the R image and 

20 the B image and P is the pixel pitch. 

Since the coefficient aL (= 1.2 x 10' 5 )of linear 
expansion of the objective lens 100 used in the above 
satisfies the relationship expressed by the expression 
(5), it can be understood that the material of the lens 

25 100 is suitable for the camera. 

Further, apart from the fluctuation of the image 
interval due to the distance to the object and due to 
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temperature change, a method referred to as pixel shift 
is used where, by shifting relatively the image pickup 
regions 120a, 120b, and 120c of the solid-state image 
pickup element by 1/2 pixel, the resolution is made 
5 higher with a small number of pixels. The amount of 
the shift of 1/2 pixel is set with regard to the 
virtual object distance of 2 m. 

As shown in Fig. 15, the image pickup region 120b 
for outputting the R image signals and the image pickup 

10 region 120c for outputting the B image signals are 

arranged so as to be shifted by 1/2 pixel both in the 
horizontal direction and in the vertical direction with 
respect to the image pickup region 120a for outputting 
the G image signals. 

15 This pixel shift may be materialized by making the 

lens portions 100b and 100c of the objective lens 100 
slightly offset with respect to the lens portion 100a, 
or may be materialized by making the image pickup 
regions 120b and 120c of the solid-state image pickup 

20 element 120 slightly offset with respect to the image 
pickup region 120a. 

In an optical filter arrangement such as the 
Baiyer arrangement, since, for example, a pixel 
provided with a red optical filter or a pixel provided 

25 with a blue optical filter is arranged between pixels 
provided with a green optical filter, an optical low- 
pass filter for suppressing aliasing is necessary. 
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However, in case of that: images having different: 
spectral distributions are taken in with regard to 
different image pickup regions, pixels provided with 
the respective optical filters can be densely arranged, 
5 and, as a result, the influence of the aliasing is 
small, and thus, a high definition image can be 
obtained without the need for the optical low-pass 
filter. This makes it possible to miniaturize the 
j,=x image pickup system and to substantially lower the 

:f 10 cost. 

t- — 

L: i 

Next, the signal processing is described. 
'"4 As described in the above, an image pickup device 

<= as 

s= having 1,800 pixels in its lengthwise direction and 800 

[3 pixels in its breadthwise direction, i.e., having 

Li: 

m 15 1,440,000 pixels in total is effectively applied to the 

ij{ solid-state image pickup element 120. Optical filters 

of the three primary colors, that is, red (R), green 
(G), and blue (B), are arranged on its front surface in 
predetermined regions respectively . 
20 As shown in Fig. 14, image signals read from the 

solid-state image pickup element 120 are supplied to 
the A/D converter 500 of the image processing system 
20. The A/D converter 500 is, for example, a signal 
converting circuit for converting the signals into 
25 digital signals of, for example, ten bits according to 
the amplitude of the signal of each pixel and for 
outputting the converted signals. Then, the image 
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signal processing is carried out in digital processing. 

The image processing system 20 has a signal 
processing circuit for obtaining image signals of a 
desired format from R, G, and B digital signals, and 
5 converts for converting R, G, and B color signals into 
YC signals expressed by a luminance signal Y and 
chrominance signals (R-Y) and (B-Y) or the like. 

The RGB image processing circuit 210 is a signal 
processing circuit for processing the pixel signals of 

10 the 1800 x 800 pixels received from the solid-state 

image pickup element 120 through the A/D converter 500, 
and has a white balance circuit, a gamma control 
circuit, and an interpolation circuit for making the 
resolution higher by interpolation. 

15 The YC processing circuit 230 is a signal 

processing circuit for generating a luminance signal Y 
and chrominance signals R-Y and B-Y. The YC processing 
circuit 230 is formed of a high luminance signal 
generating circuit for generating high luminance signal 

20 YH, a low luminance signal generating circuit for 

generating a low luminance signal YL, and a chrominance 
signal generating circuit for generating chrominance 
signals R-Y and B-Y. A luminance signal Y is formed by 
compositing a high luminance signal YH and a low 

25 luminance signal YL. 

The RGB image processing circuit 210 is now 
described in detail. 
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RGB signals outputted through the A/D converter 
500 with regard to the R, G, and B regions, 
respectively, are first subject to predetermined white 
balance adjustment in the white balance circuit in the 
RGB image processing circuit 210, and then are subject 
to predetermined gamma control in the gamma control 
circuit . 

The interpolation circuit in the RGB image 
processing circuit 210 generates by interpolation, 
image signals having the resolution which is four times 
as much as that of the 600 x 800 pixels, converts the 
image signals from the solid-state image pickup element 
120 into signals having high definition image quality, 
and supplies them to the high luminance signal 
generating circuit, the low luminance signal generating 
circuit, and the chrominance signal generating circuit 
at the subsequent stage. 

Since the sizes of the R, G, and B object images 
are already the same based on the setting of the 
objective lens 100, first, by a publicly known method, 
arithmetic processing for correcting optical aberration 
of the objective optical system is carried out with 
regard to the respective image signals. After that, 
the interpolation processing, the luminance signal 
processing, and the chrominance signal processing which 
are the same as those of an ordinary digital color 
camera are performed. The interpolation processing is 
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as follows. 

First, a G image signal which is a reference image 
signal from the image pickup region 120a is subject to 
interpolation according to the following equations ( 6 ) 
to (9): 

G2i2j = Gij ... (6) 

G2i(2j+1) = Gij-1/2 + Gi(j+l).l/2 ... (7) 

G(2i+l)2j = Gij- 1/2 + G(i+l)j-l/2 ... (8) 

G(2i+l)(2j+l) = Gij*l/4 + Gi( j +1 ) • 1/4+ 

G(i+l)j.l/4 + G(i+1)( j+l).l/4 

... (9) 

This is, 16 G elements are generated from each four G 
pixels, and thus the G image signals of 600 x 800 
pixels from the image pickup region 120a are converted 
into 1200 x 1600 pixels. 

Then, R image signals from the image pickup region 
120b corresponding to the respective positions of the G 
image signals calculated using the above equations (6) 
to (9) are subject to interpolation according to the 
following equations (10) to (13): 

R2i2j = R(i-1)( j-l)-l/4 + R(i-l)j-l/4+ 

Ri(j-l)-l/4 + Rij-1/4 ... (10) 

R2i(2j+1) = R(i-l)j.l/2 + Rij-1/2 ... (11) 

R(2i+l)2j - Ri(j-l).l/2 + Rij-1/2 ... (12) 

R(2i+l)(2j+l) = Rij ... (13) 

Since, as described in the above, the image pickup 
region of the R object image and the image pickup 
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region of the B object image are arranged so as to be 
shifted by 1/2 pixel from the image pickup region of 
the G object image, the original output of the ij 
address is applied to the (2i+l)(2j+l) address as 
indicated by the equation ( 13 ) . 

Similarly to the R image signals, B image signals 
from the image pickup region 120c corresponding to the 
respective positions of the G image signals calculated 
using the above equations (6) to (9) are subject to 
interpolation according to the following equations (14) 
to (17): 

B2i2j = B(i-1)( j-l)-l/4 + B(i-l)j.l/4+ 

Bi(j-l)-l/4 + Bij-1/4 ... (14) 

B2i(2j+1) = B(i-l).jl/2 + Bij-1/2 ... (15) 

B(2i+l)2j = Bi(j-l).l/2 + Bij-1/2 ... (16) 

B(2i+l)(2j+l) = Bij ... (17) 

By the above processing, the R, G, and B signals 
of 600 x 800 pixels from the image pickup regions 120a, 
120b, and 120c are converted into R, G, and B signals 
of 1200 x 1600 pixels having high definition image 
quality, respectively . 

The high luminance signal generating circuit in 
the YC processing circuit 230 is a publicly known 
signal forming circuit for forming a high luminance 
signal YH from a color signal having the highest 
spatial frequency component among color component 
signals. The low luminance signal generating circuit 
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is a publicly known signal forming circuit: for forming 
luminance signal YL of low frequency from a signal 
containing all the color components of R, G, and B. 
The chrominance signal generating circuit is a publicly 
known arithmetic circuit for calculating chrominance 
signals R-Y and B-Y from highly definition RGB signals. 

The recording and reproduction system 30 is a 
processing system for outputting image signals to the 
memory and outputting image signals to the liquid 
crystal monitor 4, and includes a recording processing 
circuit 300 for writing and reading image signals in 
and from the memory and a reproduction processing 
circuit 310 for reproducing image signals read from the 
memory as output to the monitor. More specifically, 
the recording processing circuit 300 includes a 
compressing and expanding circuit for compressing YC 
signals representing a still image or a dynamic image 
according to a predetermined compression format and for 
expanding the compressed data when it is read from the 
memory. The compressing and expanding circuit includes 
a frame memory for signal processing and the like. YC 
signals from the image processing system 20 are stored 
on a frame basis, the signals are read on a plurality 
of block basis, and the signals are compression 
encoded. The compression encoding is carried out by, 
for example, two-dimensional orthogonal transformation, 
normalization, and encoding according to Huffman method 
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on -the block basis. 

The reproduction processing circuit 310 is a 
circuit for carrying out matrix conversion of the 
luminance signal Y and the chrominance signals R-Y and 
B-Y into, for example, RGB signals. Signals converted 
by the reproduction processing circuit 310 are 
outputted to the liquid crystal monitor 4. Thus, a 
visible image is displayed and reproduced. 

On the other hand, the control system 40 includes 
control circuits for controlling, in response to 
external operation, the image pickup system 10, the 
image processing system 20, and the recording and 
reproduction system 30, respectively. It detects 
depression of the RELEASE button 6 to control driving 
of the solid-state image pickup element 120, operation 
of the RGB image processing circuit 210, compression 
processing of the recording processing circuit 300, and 
the like. More specifically, the control system 40 
includes an operation detection circuit 410 for 
detecting the operation of the RELEASE button 6, a 
system control unit 400 for controlling the respective 
portions in response to the detection signal and 
generating and outputting timing signals when an image 
is picked up and the like, and a drive circuit 420 for 
the solid-state image pickup element 120, which, under 
control of the system control unit 400, generates drive 
signals for driving the solid-state image pickup 
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element 120. 

Next, operation of the image pickup apparatus 
according to the present embodiment is described with 
reference to Figs. 14 and 17A to 17C. First, when the 
5 main switch 5 is turned on, power source voltage is 
supplied to the respective portions and then they 
become operable. Then, it is determined whether an 
image signal can be recorded or not in the memory. 
Here, the number of recordable pictures is displayed on 

10 the display area 13 for the remaining number of 

pictures in a liquid crystal monitor 4 according to the 
remaining capacity- An operator sees the display and, 
if a picture is recordable, directs the camera to the 
field and presses down the RELEASE button 6. 

15 When the RELEASE button 6 is halfway pressed down, 

the exposure time is calculated. When all the 
preparatory processing for taking a picture completes, 
the camera is in a recordable state, and the operator 
is informed of this through the display. When the 

20 RELEASE button 6 is fully pressed down, the operation 

detection circuit 410 transmits the detection signal to 
the system control unit 400. Here, the exposure time 
calculated in advance is counted. When the 
predetermined exposure time elapses, a timing signal is 

25 supplied to the drive circuit 420. Then, the drive 
circuit 420 generates horizontal and vertical drive 
signals to sequentially read each of the exposed 1600 x 
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800 pixels in the horizontal direction and in the 
vertical direction . 

The read signals of respective pixels are 
converted by the A/D converter 500 into digital signals 
5 of a predetermined number of bits to be sequentially 

supplied to the RGB image processing circuit 210 of the 
image processing system 20. The RGB image processing 
circuit 210 carries out interpolation to quadruple the 
pixel resolution after white balance adjustment and 

10 gamma control, and supplies the signals to the YC 
processing circuit 230. 

In the YC processing circuit 230, the high 
luminance signal generating circuit generates high 
luminance signal YH with regard to the respective RGB 

15 pixels, and similarly, the low luminance signal 

generating circuit generates low luminance signal YL. 
The calculated high luminance signal YH is outputted to 
an adder through a low-pass filter. In the same way, 
the low luminance signal YL is, after subtraction of 

20 the high luminance signal YH, outputted to the adder 
through the low pass filter. By this, the difference 
YL-YH between a high luminance signal and a low 
luminance signal is added to obtain an luminance signal 
Y. Similarly, the chrominance signal generating 

25 circuit generates and outputs chrominance signals R-Y 
and B-Y. Components of the outputted chrominance 
signals R-Y and B-Y, which come through the low-pass 
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filter, are supplied to the recording processing 
circuit 300. 

Next, the recording processing circuit 300 
receives the YC signals, compress the respective 
5 luminance signal Y and chrominance signals R-Y and B-Y 
with a predetermined still image compression method, 
and records them sequentially in the memory. 

When a still image or a dynamic image is 
reproduced from image signals stored in the memory, the 

10 PLAY button 9 is pressed down. Then, the operation 

detection circuit 410 detects this operation to supply 
a detection signal to the system control unit 400, 
which makes the recording processing circuit 300 
driven. The driven recording processing circuit 300 

15 reads the recorded content from the memory to display 
images on the liquid crystal monitor 4. The operator 
selects the desired image by pressing down a SELECT 
button or the like. 

Fig. 18 illustrates a second embodiment of the 

20 image pickup system. Similarly to the case of the 

first embodiment, the diaphragm 110 of an image pickup 
system 790 has the three circular openings 110a, 110b, 
and 110c as shown in Fig. 3. Object light that enters 
the light incidence plane lOOe of the objective lens 

25 100 from the openings is projected from the three lens 
portions 100a, 100b, and 100c of the objective lens 100 
to form three object images on the image pickup plane 
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of the solid-state image pickup element 120. 

The three lens portions 100a, 100b 7 and 100c have 
circular spherical surface portions as shown in Fig. 5 
showing the objective lens 100 viewed from the side 
5 where light is projected. An infrared radiation 

cutting filter having a low transmission factor with 
respect to the wavelength range of 670 nm and more is 
formed on the spherical surface portions while a light 
shielding film is formed on the plane portion lOOd 

10 shown with hatching. More specifically, the objective 
optical system is formed of the objective lens 100 and 
the diaphragm 110, while the three lens portions 100a, 
100b, and 100c are the imaging system. 

The solid-state image pickup element 120 is 

15 identical to the one in the first embodiment shown in 
Fig. 2. The image circles 51a and 51b overlap each 
other and the image circles 51b and 51c overlap each 
other. 

In Fig. 18, thin plates 700a, 700b, and 700c 
20 arranged on the light incidence side of the diaphragm 
110 are polarizing plates. As shown by arrows A, B, 
and C, the polarizing plates 700a and 700c are 
polarizing plates for transmitting light having an 
oscillation phase in the vertical direction of Figure 
25 18, while the polarizing plate 700b is a polarizing 
plate for transmitting light having the oscillation 
phase in an orthogonal direction ( in the direction 
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piercing the figure at right angles). 

Differently from the case of the first embodiment, 
since the optical filters for transmitting green, red, 
or blue light are not formed on the objective lens, an 
5 object image formed in an image circle 701a shown in 
Fig. 20 is a color image of linearly polarized light 
having an oscillation phase in the vertical direction 
in Fig. 18, an object image formed in an image circle 
701b is a color image of linearly polarized light 

10 having an oscillation phase in the vertical direction 
with respect to the plane of Fig. 18, and an object 
image formed in an image circle 701c is a color image 
of linearly polarized light having an oscillation phase 
in the vertical direction in Fig. 18. In other words, 

15 these formed images are linearly polarized light images 
with their oscillation phases being orthogonal. 

On the other hand, similarly to the case of the 
first embodiment, the optical filters 53a, 53b, and 53c 
are formed on the three image pickup regions 120a, 

20 120b, and 120c, respectively, of the solid-state image 
pickup element 120. Their spectral transmission factor 
characteristics are equivalent to the ones shown in 
Fig. 6. Therefore, the image pickup regions 120a, 
120b, and 120c are sensitive to green light (G), red 

25 light (R), and blue light (B), respectively. 

Polarizing plates 702a, 702b, and 702c are 
arranged in front of the image pickup regions of the 
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solid-state image pickup element 120. As shown by 
arrows D, E, and F, the polarizing plates 702a, 702b, 
and 702c have transmission axes aligned with those of 
the polarizing plates 700a, 700b, and 700c, 
5 respectively . 

Since the amount of light received at the 
respective image pickup regions are given as the 
product of the spectral transmission factors of the 
pupils and the spectral transmission factors of the 

10 image pickup regions, respectively, the combination of 
the pupil and the image pickup region is selected 
according to the transmission axes of the polarizing 
plates. More specifically, object light which goes 
through the diaphragm opening 110a is mainly 

15 photoelectrically converted in the image pickup region 
120a, object light which goes through the diaphragm 
opening 110b is mainly photoelectrically converted in 
the image pickup region 120b, and object light which 
goes through the diaphragm opening 110c is mainly 

20 photoelectrically converted in the image pickup region 
120c. In other words, by the optical filters provided 
on the solid-state image pickup element 120, the image 
pickup regions 120a, 120b, and 120c output a G image, 
an R image, and a B image, respectively. In this way, 

25 in the image processing system 20, a color image is 

formed based on the photoelectric conversion output of 
one of the plurality of images obtained in the 
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plurality of image pickup regions of the solid-state 
image pickup element 120, respectively. In this case, 
since the peak wavelength of the spectral luminous 
efficiency is 555 nm, the signal processing is carried 
out using a G image signal including this wavelength, 
as an reference image signal. 

When the pixel pitch of the solid-state image 
pickup element is fixed, compared with a system adopted 
in a conventional digital color camera in which an RGB 
color filter is formed on the solid-state image pickup 
element with, for example, on 2x2 pixel basis to 
provide wavelength selectability to each of the pixels, 
and thereby an object image is separated into RGB 
images, the size of the object image is 1//3 times, and 
thus, the focal length of the objective lens is about 
1//3 times. This is quite advantageous in thinning the 
camera . 

Further, though complementary optical filters of 
cyan, magenta, and yellow having wide overlapping 
wavelength ranges can not be used in the first 
embodiment where an image is photoelectrically 
converted selectively based on the spectrum of the 
object image, the present embodiment makes it possible 
to use such complementary optical filters, since an 
image is photoelectrically converted selectively based 
on the direction of oscillation of the light as 
described above and thus the overlapping of the 
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wavelength ranges becomes irrelevant. By using 
complementary optical filters, the light amount 
reaching the solid-state image pickup element can be 
increased compared with that when primary color filters 
5 are used. 

In addition, in case of that an image is selected 
based on the direction of oscillation of the light, 
there is a degree of freedom in arranging the optical 
filters for the color separation. Fig. 19 illustrates 

10 another embodiment where the position of the optical 

filters are changed from those in the embodiment shown 
in Fig. 18. In an image pickup system 791 shown in 
Fig. 19, optical filters for the color separation are 
provided on the light incidence plane lOOe, not on the 

15 solid-state image pickup element 720. 

Fig. 21 is a sectional view showing a third 
embodiment of the image pickup system. The diaphragm 
110 and the objective lens 100 of an image pickup 
system 890 are identical to the ones in the first 

20 embodiment. 

Fig. 22 is a front view of a solid-state image 
pickup element 820. Similarly to the case of the first 
embodiment shown in Fig. 2, the image circles 51a, 51b, 
and 51c are formed on the solid-state image pickup 

25 element 820. The image circles 51a and 51b overlap 
each other and the image circles 51b and 51c overlap 
each other. 
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Differently from the case of the first embodiment, 
a microlens 821 is formed on image pickup regions 820a, 
820b, and 820c with regard to light receiving portions 
(for example, 822a and 822b) of the respective pixels. 
Instead, optical filters for transmitting green light, 
red light, and blue light are not formed on the solid- 
state image pickup element 820. It is to be noted 
that, for the sake of clarity in explaining the 
microlens, the pixel shift among the image pickup 
regions is omitted in the illustration. 

The microlens 821 is offset with respect to the 
light receiving portions of the solid-state image 
pickup element 820. The amount of offset is set so as 
to be zero at the centers of the respective image 
pickup regions 820a, 820b, and 820c and so as to become 
larger toward the periphery. The direction of the 
offset is the direction of line segments connecting a 
center point Pa, Pb, or Pc of the image pickup regions 
820a, 820b, or 820c and the light receiving portions, 
respectively . 

Fig. 23 is an explanatory view of the action of 
the microlens, and is a sectional view showing enlarged 
light receiving portions 822a and 822b at positions 
where the image pickup regions 820a and 820b are in 
contact with each other. A microlens 821a is offset 
upward in the figure with respect to the light 
receiving portion 822a while a microlens 821b is offset 
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downward in the figure with respect to the light 
receiving portion 822b. As a result, light flux 
entering the light receiving portion 822a is limited to 
a hatched region 823a while light flux entering the 
5 light receiving portion 822b is limited to a hatched 
region 823b. 

The direction of the inclination of the light flux 
region 823a and the direction of the inclination of the 
light flux region 823b are opposite to each other, and 

10 are toward the lens portions 100a and 100b, 

respectively. Accordingly, by selecting appropriately 
the amount of the offset of the microlens, light flux 
projected only from particular pupils enters the image 
pickup regions. More specifically, the amount of 

15 offset can be set such that object light which goes 
through the diaphragm opening 110a is mainly 
photoelectrically converted in the image pickup region 
820a, object light which goes through the diaphragm 
opening 110b is mainly photoelectrically converted in 

20 the image pickup region 820b, and object light which 
goes through the diaphragm opening 110c is mainly 
photoelectrically converted in the image pickup region 
820c. Since the optical filters 52a, 52b, and 52c are 
provided on the light incidence plane lOOe of the 

25 objective lens 100, the image pickup regions 820a, 

820b, and 820c output a G image, an R image, and a B 
image , respectively . 
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When the pixel pitch of the solid-state image 
pickup element is fixed, compared with a system adopted 
by a conventional digital color camera in which an RGB 
color filter is formed on the solid-state image pickup 
5 element with, for example, on 2x2 pixel basis to 

provide wavelength selectability to each of the pixels, 
and thereby an object image is separated into RGB 
images, the size of the object image is 1//3 times, and 
thus, the focal length of the objective lens is about 
10 1//3 times. This is quite advantageous in thinning the 
camera. 

Further, though complementary optical filters of 
cyan, magenta, and yellow having wide overlapping 
wavelength ranges can not be used in the first 

15 embodiment where an image is photoelectrically 

converted selectively based on the spectrum of the 
object image, the present invention makes it possible 
to use such complementary optical filters, since an 
image is photoelectrically converted selectively by the 

20 offset of the microlens as described above and thus the 
overlapping of the wavelength ranges becomes 
irrelevant. By using complementary optical filters, 
the light amount reaching the solid-state image pickup 
element can be increased compared with that when 

25 primary color filters are used. 

In addition, in case of that an image is selected 
by the offset of the microlens, the optical filters may 
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be provided on the solid-state image pickup element 820 
instead of providing them on the light incidence plane 
lOOe of the objective lens 100. Regardless of the 
position of the optical filters, the present embodiment 
is quite advantageous from the viewpoint of the light 
amount compared with the optical path in the first 
embodiment which goes through two optical filters and 
the optical path in the second embodiment using 
polarizing plates. In addition, it is also possible to 
provide the optical filters both on the light incidence 
plane lOOe of the objective lens 100 and on the solid- 
state image pickup element 820 to further decrease the 
cross talk of images. 

As described in the above, in the embodiments 
described in the above, by constructing an image pickup 
apparatus so as to have a plurality of image pickup 
regions, an imaging means for projecting an image of an 
object so that the image extends over one of the image 
pickup regions and another adjacent image pickup 
region, and a suppressing means for suppressing 
photoelectric conversion in the another image pickup 
region of an image signal from the subject inputted 
from the imaging means, the following technological 
advantages can be attained. 

( 1 ) A thin digital color camera can be provided 
using a small-sized image pickup element which does not 
require an object image separating wall. 
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(2) By forming object images of each of the 
wavelength ranges, pixels provided with the same kind 
of optical filters can be densely arranged, and, an 
image pickup system can be materialized which does not 
require an optical low-pass filter for removing return 
aliasing. 

Further, by using the suppressing means which is 
formed with a first plurality of color filters of 
different wavelength ranges, provided on the plurality 
of imaging means respectively, and a second plurality 
of color filters of the same wavelength ranges as those 
of the first plurality of color filters, provided in 
the image pickup regions respectively, the following 
technological advantages can be obtained. 

(3) A thin digital color camera can be provided 
using a small-sized image pickup element which is 
constructed to be appropriate for obtaining a high 
color purity image and which does not require an object 
image separating wall. 

Still further, by using the suppressing means 
which is formed with a first plurality of polarizing 
means which have different polarizing directions with 
regard to adjacent imaging means and which are provided 
correspondingly to the plurality of imaging means, 
respectively, and a second plurality of polarizing 
means of the same polarizing directions as those of the 
first plurality of polarizing means, which are provided 
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correspondingly to the image pickup regions, 
respectively, the following technological advantages 
can be obtained. 

( 4 ) A thin digital color camera can be provided 
5 using a small-sized image pickup element which is 

constracted without putting limitations on the optical 
filters for the color separation and which does not 
require an object image separating wall. 

(5) Using complementary optical filters can be 
10 made possible to materialize an image pickup system 

which is advantageous from the viewpoint of the light 
amount . 

The individual components shown in schematic or 
block form in the drawings are all well-known in the 

15 camera arts and their specific construction and 

operation are not critical to the operation or best 
mode for carrying out the invention. 

While the present invention has been described 
with respect to what is presently considered to be the 

20 preferred embodiments, it is to be understood that the 
invention is not limited to the disclosed embodiments. 
To the contrary, the invention is intended to cover 
various modifications and equivalent arrangements 
included within the spirit and scope of the appended 

25 claims. The scope of the following claims is to be 

accorded the broadest interpretation so as to encompass 
all such modifications and equivalent structures and 
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functions . 

For example, in "the described embodiments, optical 
filters used for the color separation are primary color 
filters of red, green, and blue. However, the present 
5 invention is also applicable to a case where these 

filters are replaced by complementary color filters of 
cyan, magenta, and yellow. 

Further, in the above embodiments, an object image 
f= . having the highest luminosity factor (green) is used as 

j:f 10 a reference to describe change in the intervals between 

£3 the object image having the highest luminosity factor 

~'4 and object images having other luminosity factors 

a « (other colors), which is caused by change in the 

12 distance to the object. However, the present invention 

f\\ 15 is also applicable to a case where an object image 

f fi 

having the highest luminosity factor (green) is not 

used as the reference. 

It is to be noted that, in the present invention, 

the respective embodiments in the above or technical 
20 elements thereof may be freely combined depending on 

the situation . 

Also, in the present invention, the whole or part 

of the appended claims or of the structure of an 

embodiment may form one apparatus, may be combined with 
25 another apparatus, or may be an element of an 

apparatus . 



